WHKKIX HAIR VOICK C()N i K()L 
APPARATUS 

HAi ■K(iR{ lUNl) Oy 'V}\\1 !N VLNTION 

1. Fickl ihc Iiivcniion 5 
iVic prcsui! invctitifu] rclaics \o n system for contioiling 

the oj>craiicn of j)t>\vcr-cirfvcn ccjuipmt:ni. p;irticularly 
DKMori/cci w tuclch.'iirs, by vc)icc c(>niiii;intls. 

2. Description ol* the Prior Art 

I'articulnrly for persons paraly/cd from the neck down, 
the problem of operating a molori/cd wheelchair has been 
great. 

Various met hods fiavc been proposed for allowing dis- 
abled persons, including a quadriplegic, to control a motor- ^ 
i/cd wheelchair For example, brcaih -con trolled wheelchair 
systems have been proposed in which a disabled person 
Lx»nirols the chair by sucking or blowing intc> one c)r more 
iiilKS. 'Hk. iitgrec r.f control which can he provided is 
hniiied by Ihc number of lubes used. 

Voicc-ccrntiolled wheelchairs have al.Mi been proposed, 
bill the varieiy and precision of the ccnitrol they aOordcd was 
le.ssthan is desirable. I "iirther more, there was a ]iroblem with 
commands being heard by the control system and the 
jHitenlial for the control system responding to a lalse com- 2: 
matid picked up from ambient noise, such as from the voices 
of people around Ihc wheelchair. 

' SUMMARY or \ INVI:n*J'ION 

';)Ji accordance with a preferred but nonetheless illustrative 30 
embodiment of the invention, a whcclchair-mounied control 
sysiein is provided which includes a voice processor which 
ha.'^iuhc capability of converting a preselected set of words or 
other sounds spoken by Ihc wheelchair's operator as com- 
mands into a corresponding set of computer recognizable y 
sfgnals. The preselected set of vocal sounds comprises the 
commands necessary to control the state of a wheelchair, 
thai is, whether (he wheelchair is at rest, moving forward, 
pivbting left, etc. The control system also includes a com- 
piiter programmed to respond to the appropriate signals it 4^. 
rlceives from the voice processor to selectively activate a set 
oficontro] lines which, in turn, cause a wheelchair controller 
torcontrol the wheelchair in the manner specified by the 
cbrnmands given by the operator. 

- .A set of commands is programmed into the computer by 45 
a training session in which reference commands arc entered 
into the computer by the wheelchair operator to serve as a 
basis for comparison with actual voice commands to be 
given during the operation of the wheelchair. The reference 
commands can be in any spoken language and can even be sc 
in the form of non- language sounds, such as coughs, guttural 
sounds or hums, for operators who arc unable to speak 
words. 

'ITie control system is arranged to accommodate backup 
commands in case a principal command is not recognized or 5. 
not given. The backup commands can include commands 
having sounds which arc likely to be recognized if the initial 
commands are not recognized. 'I'hc backup commands can 
also include emergency commands, such as an exclamation 
likely to be uttered by the operator in a panic situation to stop a 
the wheelchair It is also contemplated that any of the 
■ommands can be based on the characteristic frequencies of 
le operator s voice, such that the frequencies of the sounds 
vcn as commands must match the frequencies eniered into 
memory of (he computer during the training session in 6: 
er that the system recognizes and responds to the com- 
•ds. 



The ccmirni sysicfii npcnilcs in various modes, in at least 
one of whic h ihc cfMiirctl sysicm recognizes and responds to 
fewer ihan .ill of MMintis, or commands, that the control 
system rec{<i;iii/es jikI responds to overall. l*or example, in 
a STOP mcuii . the cnnirnl system does nol recognize a sound 
or commiintl CiC l.LI'T, whereas the same command 
given whik tiie eriiiml system is in a I'ORWAliD mode 
causes the \v iK-elclr;i! !<) Uirn to the left by a predetermined 
amount while niDvliig forward and to continue to move 
forward in 'he new direction. 

The system includes a microphone applied directly to the 
larynx of the c\peraior and shielded hy outside coverings to 
prevent input lo the sysiem'of vocal commands from persons 
around the operator. A display visible lo the operator indi- 
cates the vocal command being executed by the control 
system, and audiMe indicator alerts the operator lo certain 
system conditions, such as the inability of the .system to 
recognize a command. 

Although an ithiviiiUive embodiment described herein 
relates to appiicati(!n of the present invention lo a motorized 
wheelchair. !he pres'.-ui invention is also applicable to other 
motorized ;ind oihei power-driven devices. The other power- 
driven devices include, but are not limited to, other vehicles 
and personal carriers including beds, therapy devices, elec- 
trarnechanically augmented powered skeletal supports, and 
television, stereo and other electronic equipment. 

■1 BRlld- OUSC'RimON OH THE DRAWINGS 

"FIG. 1 is a perspective view of a motorized wheel chair 
employing ilie control system according lo I he present 
invention; 

"^FIG, 2 is a block diagram of the components of the control 
syslem according lo the present invention; 

:1 -FIG. 3 is a diagram of commands and modes of operation 
for the control sy.sicm according to the present invention; 

. TIG. 4 is a schematic view of a wheel chair according to 
the' present invention showing a mechanism for reclining the 
Operator; and 

: T'lG. 5 is a schematic view of an arrangement for adjust- 
ing the positions of the seat and seat back of a wheelchair 
according to present invention. 

f'l DEIAILEO DEvSCRIPTION OF PREFERRED 
EMBODIMENT 

As can be .seen from FIG. 1, a wheelchair 10 has main 
wheels 12. an electric motor 14 drivingly connected to one 
of the main wheels, and a similar electric motor (not shown) 
drivingly connected to the other of the main wheels. The 
electric m(U(Ms 14 are, for example, DC motors. The wheel- 
chair 10 has two known types of brakes (not shown) — 
brakes of a first type physically contacting the main wheels 
12, and brakes of a .second type on the electric motors 14 
providing power to the main wheels. ^Fhc power for driving 

s the motors 14 is from by a conventional battery unit 16 
providing 24 volts 0(". 

As can be .seen from FIGS. 1 and 2, the wheelchair 10 also 
comprises a control system designated generally by the 
numeral 20. the ccuitrol system including a computer 22, a 

1 wheelchair controller assembly 24, a controller interface 
module 25, an LED visual display 26 mounted in a position 
where it is visible l>y (he operator, and a microphone 28 for 
entering commands into the control system. A training 
station 30, which includes, for example, a keypad, mouse 

y and video monilr^r. is also provided for programming the 
control system ai a lime when the wheelchair is nol in 
normal operation. 



A sou ml in!riprci:ilio!i nuKlulo 32, or citrd, is ktiown aiK.l 
is insiallahlc on ihc compulcr 22. A siiiialilc sound inlcrprc- 
liiiion modiiK- contincrcially av;n"kihlc under the n;imc 
fVi:;i!ivc Dcsii'.n Sound C^iicl Uom Oc'itivc Tcchnok^L^v I Ul. 
ofSingaporc. I he conipuicr 20 is connected to the controller 
intLifiice nKnii.ie 25 ihrough the ! .liO visual display 26, 
which also acts as a switch box. I'hc controller interlace 
ni{\(lule 25 c^rwns M-nals iVoni the conipuier 20 to ihe 
opening :incl ch-^ini; <m electrical circuits in the controller 
a.sscinhly 24 lu control ihe How t^f current to the motors 14 
and the brakes in various ways to change the slates, that is, 
to control the niovenient oi' the wheelchair 10. 

The wheelchair c(uitrolier assembly 24 includes the 
switches which are actuated and the circuits which arc 
a Heeled by the actuation of the switches to control current to 
ihc motors and brakes. The wheelchair controller assembly 
24 can compii.^e a cr.fn'cmional joystick wheelchair con- 
troller assembiy excep; that the jftyslick itself is omitted, 
liatlier than tiu: position oT a joystick determining which 
.swiiehcs arc .tcnia-ed and. therelore, what cx^nibinalion oi" 
motors and biakes is or-erated, electrical signals are trans- 
mitied from die intcilacc cCMitroller module 25 to the wheel- 
cliair controller asscniMy 24 to (Operate the switches. The 
signals can Ik in I he )\>rfn of numbers of electrical pul.ses, 
wherein c\;rtain numbers of" pulses actuate certain switches 
or certain combinations of switches in the wheelchair con- 
trollef as.sembiy 24. A suitable wheelchair controller assem- 
bly that includeii wiih the Arrow Action Storm wheelchair 
j)rodUccd by Invacarc ol' lilyria, Ohio. 

^Uj. 3 shows the relationships among various modes of 
ojicriaion of the control system 20, which are identified by 
comrnands which can be used to place the control system in 
thert^odcs. b'K'i. 3 also reflects the states of the wheelchair 
1 0 a ffer the commands are given. As an example, from a first 
mode of the control system 20, idcntiGcd in FIG. 3 by a 3 
I'OjWARD box, and corresponding to a state in which the 
wheelchair 10 is moving forward, the control syslcm 20 is 
rcccpriive only to the commands STOP, GO RIGHT, or GO 
LliK-JT. The control system 20 responds to these commands 
^^yfRj^cing the wheelchair in the state indicated by the 4; 
comqiand. As another example, from a second mode of the 
codj?^)i system 20, identified in FIG. 3 by a STOP box, and 
corresponding to a .state in which the wheelchair 10 is 
stopj^d, the control system 20 is receptive only to the 
commands FOkWARO. BACKWARD, PIVOT RIGHT, and 4 
PIVOT LEF'i". Uach of the boxes of FIG. 3 except TRAIN 
COMMANDS, RES\:\' and "NOT RECOGNIZED*' repre- 
sents a command, a mode of the control system 20, and a 
state of the wheelchair 10. Of course, other commands, 
modes and states can be used instead of or in addition to 
those disclosed herein. I'or each mode of the control system 
20 only a very limited number of command options must be 
searched by ihc comjiuter 22 before the correct option is 
found and cxeculed. Thus, the control system 20 provides 
very quick response lo the commands. In the embodiment 5 
described herein, no rn{)rc than four commands must be 
considered from any particular mode of the control system 
20. 

In any of the modes illustrated in FIG. 3, Ihe control 
system 20 is .switch able by voice command between a first f 
condition in which the control system is responsive only to 
a single, prepalory command and a second condition in 
which the control system is responsive to all or some other 
commands. I'or exanijile, the voice command WAKE-UP is 
a prepalory command which can be used to switch the < 
control sy.stem 20 from the lirs! condition described above (o 
the second condition described above. From the second 



cfnuiiiion, I Ik* sysit-ni rca>gni/cs most other coinni*'inds, 
such as rOKWARO. HACKWAKI), PIVOT KICMT and 
IMV'O'I' \ .\i\-"V In !lu' sca^nd condilion, the system is iilso 
receptive lo comm.TiKls from llie iraiuing slaiiori 30 and a 
KL'SIiT conim.'ind. I'Vom ihc second conch'tion, the control 
sysic rn 20 is .:iso recepiivc to a command, such iis GO-TO- 
Sl LIIP, to rcinrn lo ihc first condition. 

The conirol system 20 is also jirogriimmahlc fo lie respon- 
sive lo a command lo actuate an operation or a series of 
ojieralions hy which the wheelchair moves from a first 
predclcrnnineti position, such as next to a bed, to a second 
pretietermincd posili<ui, such as one suitable for storing the 
wheelchair tiuring periods of non-use. In this mode, the 
wheelchair 10 slops when it reaches the second predeter- 
mined position. The control system 20 can also be pro- 
grammed to rccogni'/e and respond to a command to move 
from the sec(^lld predotermincd pc^sition to the first prede- 
termined position and then stop. A command for movement 
from the first }Hedetermined position to the storage position 
can be "GO 1V\RK'"\ and a command ft^r movement from the 
sl(»iagc position to the first predetermirtal position can be 
"COME IILRb''. These commands are entered through a 
wireless dirt ciional microphone positioned at the first pre- 
dclcr mined jiosiiion. 

F£om a STf )l' mode of the control system 20 and a STOP 
stale' of the wheelchair 10, a variety of commands can be 
giv^h, such as FORWARD, BACKWARD, PIVO T RICH IT 
andiTlVOr LLI-T. For each of the BACKWARD, PIVOT 
RfOjlT and PIVOF I,LFT aimmands, the wheelchair 10 
continues in the commanded direction until a STOP com- 
maiHl is given, at which lime motion ceases. A STOP 
command also ceases motion when the wheelchair 10 is in 
a ^iQRWARD stale. Other commands, such as GO RIGHT 
and GO LEFT, arc also used when the wheelchair 10 is in the 
FQl^WARD state. In such cases, the wheelchair 10 turns a 
predetermined angle in the commanded direction and con- 
liiTues moving forward in the new direction. Furthermore, 
repeating GO RIGH'l' or GO LEFT commands results in 
fu^-lfier turning in the commanded direction by a further 
precgjtermincd angle. A predetermined incremental angle of 
7.|,ijcgrecs has been found to be suitable. As was indicated 
earlier herein, instead of commands like FORWARD, 
BACKWARD, etc., the control system 20 can be trained to 
recognize and respond to any sounds, which thereby have 
the same elTect as the FORWARD, BACKWARD, etc. 
commands described herein. Each command causes a 
unique electrical signal or set of electrical signals to be 
transmitted to the wheelchair controller assembly 24 to 
acliievc a .specific change in the state of movement or 
non-movement of the wheelchair 10. 

The control system is arranged to accommodate backup 
commands in case a principal command is not recognized or 
noi given. The backup commands preferably comprise com- 
mands having .sounds which arc likely to be recognized if the 
initial commands are not recognized. The following is a list 
of primary commands, shown in the left column, and a list 
of the corresponding backup commands shown in the right 
column. 
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The conlro] system recognizes cither ihc primary comniiind 
or the backup command ami takes the Cdrnmaiicicd action. 
'I'he backup commands can also include emergency 
commands, such as an exclamation likely to be uttered by 
the operator in a panic situation, for example, "Oh, no!", to 
si(^P the wheelchair. Any of the commands can be bascd'on 
!hc charactcnsiic frcc|i)encies of ihe operator s voice, such 
ihai Ihe frctiiiLiicies ft ihc sounds i:ivcn as commands must 
maich the Irtciuencics enierecl inui ihe memory of the 
t f-inputer dnr iiig ihe i raining scssion. if, 

Any lime liiai a \-.Mce extnunand is not recooni/.cd by the 
o-ntrol sysum 20 and Ihc wheelchair 10 is'' moving/, the 
coiiiro! sysiem causes the wheelchair lo sic)p and emits an 
aitchble signal or alarm. The control system 20 acts to stop 
ihe-wheelcliair 10 and emit ![)c signal a short time after a 25 
cormmand is not recognized. A suitable time is 0.6 seconds. 
I he^ control sy.stcm 20 can be arranged to allow a certain 
imvc for recognition of a further command, after a first 
command is not recognized, before stopping the wheelchair 
Hf .and cmiiiing the signal. The audible signal or alarm is x 
transmitted by an audio feedback .sy.stem 34 to the operator 
lhr:c>iigh an car phone 36. The use of an ear phone 36 assures 
lhaljthc operator will know that the voice command is not 
re|xjgnizcd, despite the presence of noi.sc around the opera- 
tor and despite any hearing loss the operator might suffer 35 

Qlie microphone 28 is a throat microphone of a known 
typcj which contacts the larynx for clear, positive transmis- 
si^njof sound vibrations and for clear distinction from 
arti|ienl voices and sounds. Except for a sensing portion 40 
which contacts the larynx, the microphone 28 has a covering 
wHigh shields out ambient sounds and, thereby, prevents the 
comrol system 20 from operating in response to a false 
command from ambient voices and sounds. A suitable 
microphone is commercially available as Lash 11 Headset 45 
from Television Equipment Associates of South Salem, N.Y. 

Ilic computer 22 can be a conventional business or home 
personal computer operating from the battery unit 16 of the 
wheelchair 10 ihrougli the recharging socket. This ensures 
that the computer 22 can be removed from the wheelchair 10 5C 
so that it may be employed for other purposes when not 
serving as a mobility device, 'fhe battery unit 16 is a 
standard unit providing 24 VDC and delivering 2.5-5 V to 
tlie computer 22. 'I"he computer 22 employs reducers and 
inverters to allow operation with both current from the s: 
b;iltery unit 16 and household current. Such a computer is 
more powerful than is required for the control system 20 but. 
be.sidcs being useful for other purpo.ses when the wheelchair 
10 is not in u.se, the computer is well-suited for easy physical 
connection to commercially available sound interpretation & 
modules 32. Instead of a personal computer, a microproces- 
sor can be used as the computer 22. 

An electronic balun 38, connecting to the computer 22 at 
the ports for the screen, keyboartl and mouse connection, 
substitutes for Ihc lack of conventional input/output. No 6 
keyboard, mouse, joysiick or video .screen is connected 
during the operation of Ihe wheelchair 10. 'I'hc use of the 
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h.lmi 3S alU'V.s -iuu- Mt.chmcni of ihcsc devices tor 
inMollMion, liinnu, nwnnicni.ncc one) scp.'icc al n lalcr ct:nc 
N^'illK^m inicrruriimj; opcrMion. 'Phc balun device :^cls as l^ 
^niK-aic lor t'lA \muu^\ nian-miichine inlcrtaces which, 
whc.rnoi connuied (^r rtccoiuitcd for, require ihc co.npmcr 
i^Mie a iaul! Mrorcondiiion which prohibits ihe coiupiifur 
rnnn operMin- A suit:.blc Ix.Uim is the Guardian bahn. troin 
l^ariuin CVmpniers, hic r-!* Schcncciady, N.Y. 

limergencv sioppiti- mcchiinisms can be empioycci to 
override any tailurc in the conlrol system 20, including m 
the svslcm vruce rcc(vj,nilion software in the sound inter- 
prelahon module 32. Ti^e fKst mechanism is an atlcrnatc 
acticm head swhch which is operated by slight movement ot 
the head to deactivate the wheelchair conlrol system. Ihc 
second is a conventional puff and sip control device readily 
available to tlic opcriimr. 

'Phe compnttr 22 onitrois the controller mlertacc module 
■'S nccordin- the v^eal commands received. The conlro!- 
k-r interfac^rmfHlulc 25 controls the controller 24. which 
controW the i^i-i<:!s K and brakes. '!'hc controller interface 
module 25 is .>Machnl m ihc normal l/C) port of the computer 
22 u-sini: ehliu- p;ir;>lM or serial methods. 'I'he controller 
i'nierVace^moJiile'25 converts impulses received Iroiv, the 
computer pni! and tMOslales them into circuit opening or 
closing functions lo open and/or close circuits in the con- 
irollir asscmblv 24. 

ablput Ir.Mii the control system 20 to the operator is 
necessary for oMilinnation and lo provide meaningful iiilor- 
mution The primary means of output employs lamps 42 on 
the Visual display 2^^> indicating which lines trom the 
cohrbller inii rface nuKlule 25 to the controller assembly 24 
are ib open. t inn. Two conditions drive audio feedback from 
the iompuicr 22, the iirst is an audio bell alarm which rings 
wHdh the command is not recogni/xd. The second is based 
oiMscr query. The operator may request system status or 
request audio confirmation of command or available/ 
accq^iable word commands which have been programmed. 

'%c training station 30, which is usually detached and 
us^cf only during training, includes a computer video screen, 
a computer keybo;ud. a mouse, trackbaU or other cursor 
cofili-ol device, and an optional modem, if it is not contamed 
inShe computer 22 mounted on the wheelchair 10. Since the 
con&ol system 20 nuist be "trained" to recognize the indi- 
vidual voice (pilch, accent, etc), the commands needed lo 
move the pariicuhu model of chair need to be mstallcd. 

As can be appreciated from FIGS. 4 and 5, vocal sounds 
can be usetl with the motorized wheelchair 10' according to 
the present invention not only to conlrol the travel of the 
wheelchair, but also to conlrol the stales of other devices, 
■ such as devices to conlrol other functions associated with the 
wheelchair, l-or ex;miple, as can be seen from I'IG. 4, the 
control system 20 according to the present invention can be 
used to control, be yoice command, a till or recline position 
of a seat 42 and .seat back 44 of the wheelchair 10*. In MG. 
. 4, the wheelchair 10' according to the present invention is 
shown having mam wheels 12\ pivoting wheels 46, a 
platform 4S supported by the main wheels and pivoting 
wheels and a seal frame 50 supported for tilling, or reclining, 
movement relative to the platform 48. In the embodiment 
1 shown in I'lG. 4. a connecting member 52 connects the 
platform 4S to a hub 49 of the main wheels 12', and the seat 
frame 50 is pivcMally mounted relative lo the platform by a 
pivot connection 54 secured to Ihe connecting member 52. 
The seat frame 50 includes a base member 56 and an upright 
s member 5S at a fixed orientation relative to the base mem- 
ber. The scat frame 50 also includes arms 58 and members 
60 for supporlin^^ the seal 42. Foot rests 61 are connected to 
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\\k seal ir.snu: 50 lbr iiit'vcnicni (hcrcwiih. A control cluvicc 
f>2, such its ;< scr\'(Miuxhnnism of i) lypc which is 
coiivcniional, i-^ c^nni cictl hctwcou the plailbrm 4S and the 
l\'isc member 5n oi ihe se;ii iVame 5(1. 1'he control device 62 
iiiciudcs an cknicnt which is moveable in response to a 5 
siLiMa! Irom Ilic conirt^) system 2(* lo increase or decrease tiie 
iieiL',ht oi" a iorv.';i(d end the base member 56 uT tfie seat 
liaiiie 50 to inciLiise c^i decrease the amo\int ofrccline o!" the 
seat 42 and iht se;it baei< 44, along with the arms 58 and the 
f(^ol rests 61. I jius, ihc control device 62 is controlled in j 
miicf) the same manner as Ihy motors .14 and brakes of the 
vs'heelchair 10'. 

As can be appreciated IVom FIG. 5, vocal sounds can also 
be used with the wheelchair 10 according to (he present 
invention to adjust the positions of the seat 42 and the scat i 
back 44. Both the scat 42 and the scat back 44 may have 
cushions of vaiious cnntigiiralions. Control devices 64, 68 
and 70, such .^TV(uiK'chanisms, are positioned between 
ihe seat siippoi ! membvr 60 and ihc scat 42, and between the 
Npritilil menilur 5S anci ihc seat back 44. Various combina- 
Ik His of aciuaiinn o!' ihe individual control devices 64-70 
prcivide the capal^iliiy move the seat 42 and the scat back 
44 in vitrious ^vays, ]\>! example, the scat 42 can be raised 
or lowered and/or tilled forward or rearward. Similarly, the 
seat^hick 44 can be moved forward or rearward and/or tilted 2 
more 'forward nr more rearward. Various known arrange- 
menJSvOf scats, .^at backs and servomcchanisms can be 
useci, jhe important consideration being thai they arc oper- 
able"- by voice commands in connection with the i)rcscnt 
invchtion. y 

Sprjie wheelchair operators are unable to support their 
he a ds.| Accordingly, supports are known for holding up the 
lieacj Of a wheelchair operator. As can be seen from FIG. 5, 
the ■\<^heclchair 10 according to the present invention 
includes a head .support 72 connected to the wheelchair 3 
Ihroiigh, for example, the generally upright member 58 of 
the sG|it frame 50. Tlie head support 72 is connected to a 
hea4;7Upport adjustment mechanism 74 containing an 
arrah^mcnl of one or more servomcchanisms for turning 
the f^iid lo the right and left and for tilting the head forward 4 
or rearward. The adjustment mechanism 74 is connected to 
the cojilrol system 20 and is controlled by vocal sounds in 
a mantier similar to the manner in which the motion of the 
wheelchair 10 and the a.ssociatcd equipment, such as the seat 
42, are controlled, l-or example, the turning of the head can 
be controlled with commands such as RO'i'ATE LEFT and 
KG TATE RIGIi r. 

'Hie voice commands of the wheelchair operator arc 
entered into the memory of the computer 22, and these 
stored commands are later compared with commands ' 
received during the operation of the wheelchair 10. When a 
command received during operation matches a command 
entered during the training session, the wheelchair responds 
lo the commands. If commands do not match, the wheelchair 
10 docs not enact Ihc command given and, thereby, the 
wheelchair is prevented from responding to commands 
which include either the wrong terms or the right terms, at 
the wrong pilch, accent, etc. 

It will be apparent to those skilled in the art and it is 
contemplated that variations and/or changes in the embodi- ( 
ments illustrated and described herein may be made without 
departure from the present invention. For example, the 
system can be used with beds having motors to change the 
po.sition of the occupant, and the like. As another example, 
although the present invention has been specifically dis- v 
closed with reference \n motorized equipment, particularly 
motorized wheelchairs, it is applicable to equipment which 



